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ABSTRACT 

Four groups of people were requested to review the 
Band Corporation's design for a longitudinal study of school 
desegregation, ffhen the study design documents were sent to the 
reviewers, an evaluation questionnaire was attached. The reviewers 
were asked to add any needed clarifying comments in the spaces 
provided after each question, and to write up to six pages (single 
spaced typing) of additonal comments. The most important points are 
listed in this di-tcument for each reviewer, and an attempt is made to 
indicate whether the reviewer's overall view is positive or negative. 
Many of the reviewers criticized various aspects of the proposed 
instruments. The narrative comments provided by the reviewers suggest 
a wide spectrum of opinion about the Band study design. Despite the 
fact that there ate areas of clear disagreement, there are also areas 
of clear agreement. There is disagreement about whether the 
Commission should try to implement a study based on the Band design. 
There seems to be fairly strong agreement that the Rand study, and 
perhaps any feasible study, will not produce many unambiguous answers 
to important policy questions, but a majority of the reviewers also 
felt that such a study could provide more reliable answers than are 
presently available to some of those questions. (JH) 
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SUMMARY OF REVIEWERS COMMENTS 

prepared by 
Robert Grain 

The Rand Corporation 
November 197 



Following are brief summaries of the Important points made by each 
reviewer. The four types of reviewers (Civil Rights Commission staff. 
Civil Rights Activists, Government agency staff and professional 
researchers) are grouped separately, but there is no order within each 
category. The most Important points are listed for each reviewer, and 
an attempt is made to indicate whether the reviewer's overall view is 
positive or negative. Many of the reviewers criticized various aspects 
of the proposed Instruments; to avoid unnecessary duplication that 
criticism is noted here rather than below. 

Lee Cronbach 

Cronbach is very critical of the report. He specifically focuses on 
two major criticisms; first, the use of a matched quartets design, 
which he believes is wrong and should be replaced by more conventional 
random samples; secondly, he is opposed to tht^i experimental design for 
studying the Impact of innovations. His argtiment is that it is 
impossible to put Innovations in place without them being drastically 
altered by their environment; innovations run in an experimental setting 
arc different from innovations rtm in the real world. He also is 
pessimistic about the whole innovations strategy that has been used 
in the last ton years in educational research. 

He dislikes the one-year longitudinal survey on the grounds that student 
gains over that year would be too small to measure accurately. 

Cronbach is not Interested in some of the non-cognitive effectj; "the 
extra-curricular question is just plain unworthy of discussion.... if 
there is an effect it is probably on student morale. I don't find in 
this study a serious attempt to find out if the programs are accompanied 
by good educational results. And without that evidence no policymaker 
should listen." 

Cronbach' s most favorable views are toward the case study approach, both 
In the politics of desegregation and in observing schools as they go 
through tha first few years of desegregation. He is concerned about 
weaknesses in the methodology: "The closest attention to the Issues of 
quasi experimentation, bias in analysl& of covariance and effects of 
nonreprcsentatlve sampling should be given before any move is made toward 
Structured studies." 
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Tom Pettlgrew 

Pettigrew is very favorsible to the project and par tic alar ly praises 
the general strategy of the data bank plus ancillary studies. He 
would modify the study to place the entire emphasis upon prospects for 
Improving desegregated schools. He writes: 

There should be no simple input-output aggregate effect 
study of desegregation vs. segregation on achievement (or 
Other variables) without the mediation of process variables 
(many of which under this proposal would not be fully studied 
until late in the six year cycle). 

There should be no one-year longitudinal reporting of results 
In order to answer (inadequately) some felt need for "early" 
policy relevant.... results. 

The price tag may seem large but I think it is relatl/ely 
cheap if you compare it to the amount of money that the Federal 
government has already spent on research in this area in the 
past decade. 

Elsewhere he adds : 

Section IV--whlle it may seem jargon laden in spots, is 
one of the best 75 page summaries I have ever seen on the subject.... 

Jane Mercer 

Briefly, Mercer takes the view that survey research approaches are 
futile. She argues that the differences between schools are too 
small to be analyzed and that politically one runs the risk of further 
research which says that nothing can be done to lielp minorities. 

She also argues against the comparative case studies of the politics 
of desegregation on the grounds that, as designed, the study has no 
theoretical perspective. She generally favors cutting the whole 
project down in scope in order to make it administratively manageable. 
She argues strongly for the experimental version of the innovation study 
and wants to cut everything else down to focus on the study. 

Ralph Tyler 

Tyler is generally favorable to the project, but has a couple of sharp 
reservations. His most important is that the use of standard achievement 
t^sts is a serious mistake. He presents a two or three page well- 
reasoned essay calling for the use of criterion-referenced tests. 

Briefly he argues that national standardised tests really measure only 
innate ability, even if they are called achievement tests; he states 
that a true achievement test must test the child on what his school has 
tried to teach him. He also argues that many teachers do not know how 
to teach low income students or black students. We must add to the 
itudy more concern with the academic content of the teacher's behavior* 
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He criticizes the experimental school Innovations design on the grounds 
that It is Impossible to get control over the teacher's behavior and 
the experiment would thus be Invalid. I think this is very close to 
Cronbach's position. 

Barak Rosenshlne 

Rosens' ne's comments parallel some of Mercer's. He feels that surveys 
have ' complished little. He also thinks that the effects of desegrega- 
tion 1 achievement will be small because he believes school effects are 
generally small, and that this is a reason not to embark on this project, 
"lo you want another study that concludes that the schools don't make 
a difference?" He is also very critical of the proposed classroom 
observation measures and the analysis of what happens in classrooms 
generally. He endorses the idea of experimental studies, but seems to 
find nothing of value in the Rand project. 

Morton Deutsch 

Deutsch's evaluation is extremely favorable. He likes the overall study 
and especially likes the experimental version. He is pessimistic about 
school districts cooperating and recommends a feasibility study to 
determine this before going further. He recommends that considerable 
work be done in determining the policy questions which policymaKers have 
about desegregation. He writes, "I would recommend (funding the 
experimental design option), but I would suggest that complete funding 
be delayed until after a feasibility study.... (this) would «ntail 
•experience surveys' of selected categories of people--critically 
relevant to the policy process-- to identify the issues for which they 
are seeking additional knowledge and information. It would then require 
selection of several key issues and formulation of experimental designs 
that are appropriate to providing answers to these key questions." He 
closes his letter by writing, "let me state again my very favorable 
reaction to the quality of the proposal. We are in a state of ignorance 
about many issues that the proposal is addressed to. These issues are 
of fundamental importance to the well being of our society and they warrant 
repeated large-scale efforts to develop the knowledge that is needed. The 
amount of money beinp r^^uccted is relatively small compared to the 
research and development expenditures accompanying many minor forms of 
technological change," 

M. Brewster Smith 

Brewster Smith's overall view of the proposal is extremely favorable. 
He la, however, concerned about the serious difficulty of research 
Bttnagement of a project of this scale. Nevertheless, he believes that 
this is the kind of effort that should be made. He writes, "I whole- 
heartedly endorse its ambition in regard to the appropriate scale of 
the endeavor. When I was Chairman of the Social Science Advisory 
Commit tee to NSF, we bemoaned the piddling scale of so much social and 
behavioral research. Not that social sciences are ready to deliver a 

o . ^manhattan project' to solve social problems-- far from It. But serious 
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on serlcus problems dc« «."J;^e a^cle Invesc^nt beycnd^that^ 
a fine chance to show that concentrated Investment of funds 

research across the board." 
Alexander As tin 

Astin is concerned that the relationship between fli'^y^"^/^""^^"^ 

c.„li bl^o" e";?Icit and avoid the use of euphemistic and a.b.gucus 
terminology in stating the alms of the project. 

».t<n favors the experimental variant. He argues that since the 
««vi«nt is designed to test the merits of feasible programs then 
tSTse ^^nova ions.'lf they are feasible, can "e randomly executed 
nnally. he argues for "»« use of cbservat^a d a a <i reater 
emphasis upon peer group relations. His summary reaua 

Much greater use of direct observational behavior at the school 
level (pre and post). 

Extension of the study into post secondary education, with 
given to%he utilization of existing longitudinal data to assess impact 
of desegregation during the 1960's and early 1970 s. 

Revise current instruments to place a greater emphasis on vocational 
and career aspirations and. particularly in the older groups, to 
assess impact on peer group interaction. 

A,tln-s perspective (from the viewpoint of one who has do^e res^^^^^^^^ 

"i're:L^te're:: icl'ca doi . enfctln cL greater success 

^^^L^^l^^^ f^eflinrgr-cf t=i 
people. 

J . Stanley Ahmann 

i n4^^^*-n^' nf the National Assessment. Ahmann' s main points 

Strtro^ihe t'Sy'S s arteS without convincing evidence that the data 
Tth r?'g ins u»nt proposed la suitably sensitive " -asure sma 
dl«orcn«8 displayed by the various (groups) under study. His view 
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of the experimental design option Is that it is only as good as the 
quality of the innovations being developed. Finally, he supports the 
Idea of measuring a wider range of cognitive skills. He thinks we 
should go past basic skills to get at such a wide range. Two of his 
recommendations arc : 

1, Establish a panel of so-called policymakers interested in this area 
immediately. Probe them intensively to discover the major policy 
questions which they wish to have answered. On the basis of these, 
a re-examination of the plan should be made in order to determine 
whether there is reasonable compability between the interests of 
the policy makers and the potential outcomes of the various studies. 

2, An advisory commettee of policy makers and representatives of funding 
agencies should be functioning at the beginning of the study and 
should examine with care the coordination of various parts, giving 
particular attention to such sensitive areas as the study of innovative 
schools. Such committees should be highly instrumental in the process 
of encouraging and assisting the funding of additional research not 
now formally a part of the research plan. 

He closes by saying, "In order that there be no confusion in this matter 
let it be said forthrightly that the research design has an immense 
amount of potential and should be pursued vigorously." 

Robert K. Merton 

Merton's main point is that we should be pessimistic about the policy 
utility of research. We should not assume that the reason why previous 
research has not been policy us.eful is because the research was not done 
well. He writes that the Commission must recognize that any research 
will have limited policy utility, it will be "taken into account and 
turned to account" by the whole collection of different groups involved. 

He wants the project restructured so that all of the analysts get a chance 
to participate in designing the instruments. This is to avoid the 
problem of the secondary analysis contracts not being intellectually 
attractive to people. Merton is disturbed by the use of the word 
"Anglo-American," 

Marshall ("Mike" ) Smith 

Mike Smith doesn't like the report's discussion of what happens in 
schools nor the recommendations for research on what happens inside 
schools. He writes "another modified 'planned variation' design is 
fine in principle but a disaster in practice until w^ know something 
more about how children learn in schools," In our November 1973 meeting 
he argued for funding basic theoretical research on educational process, 
and seems to still hold to that position. His suramaryj 
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1. Your costs will be much greater than Rand estimates if you carry 
out the whole study, 

2« I would concentrate on trying to figure out ways to make desegrega- 
tion peace ful--on the socio-political determinants of smooth 
desegregation rather than on the classroom practice analyses. 
(This is only in the context of the Rand report, for I feel they 
are rather strong on the former and weak on the latter.) 

3. Figure out precisely which policy questions you wish to answer 

from the Federal . level , for the State level and for the local level. 

Generally, I suspect those questions need only descriptive studies 

to provide answers—not studies designed to answer causal connections. 

Robert L. York 

After a brief sentence of kind words about the Rand design, York focuses 
on two points. First, he would modify our design which involves selecting 
"promising programs" to study over a period of time. York's alternative 
Is to select a grou- of exceptionally effective schools, and study 
them, but he also notes there have been difficulties with this latter 
approach. 

His letter discusses in detail ideas for management structure of the 
project which are too complex to summarize briefly. 

Trudt Lucas (NSF-RANN) 

Trudi Lucas focuses on a single issue--measuring the real differences 
between minority and majority schools. She makes two main recommendations 

1, Get program cost and total expenditure data. 

A. Budget decisions are important policy instruments. No decision- 
maker is likely to act on recommendations for program changes 

to make integration work without knowing a) how much costs 
will average; b) the threshold of investment required to make 
the programs meaningful. 

B. The equity of expenditure issues across minority and majority 
schools is not a dead issue. Also differences in the price of 
buying and maintaining the same quality of physical resources 
haven't been, to my knowledge, estimated. Urban-rural and 
regional differences in total expenditures are real and connected 
with differences in educational outputs and distributions of 
majority and minority peoples. 
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2. Measure school quality directly . 

A Indicators of the presence or absence of facilities and programs 
do not adequately reflect differences in quantity, quality, age 
or even cost of equipment • 

B. Teacher quality varies after controls for educational credentials. 

C. Financial mis -management seems to be a real issue in evaluating 
education for minority students. 

L«.s concluies by saying, "Of all the impressions left "l^^^^^"" 
his followers, the mbst clanging and unsubstantiated is that notion 
rhit therfls no explanation for minority failure to be constructed 

dif fLenc^ in'the provision of high quality educational resources. 

Rav Rist 

Rist has recently joined NIE and is responsible for research on 

integration! He ^ 8 points in his letter. (1) He argues that 

t£ Tistincaon between desegregation and segregation f -f,,,, 

in terms of the local cultural context rather than as a simple statistical 

in terms or une understated the political 

pr': rs i rlab . and d'o not h^Je strong historical data on the political 

process yariaui=», areues that the project does not have 

process in "^^ district (3) He arjues tha P^^^^^ ^^^^^^ 

^o^s^ucrre M) He argu^ that « have Ignored Important literature. 
W He eUeies'that the 'safeguards on confidentiality of » 
^ , u« nhcprvps that without mandatory cooperation, response 

« probS ; bri™! a Ue beueves'that the -"^V f 
focused too heavily upon the anti-integration attitudes of ""Ite parents 
fr^hUe elites aL not enough on aspirations va ues or beUefs^of^^^ 

;s:arrde^:^iM™iw^::i. ieLgfegrtiris ^-^^^^^^ ^ 

design to determine how desegregation could be made to work better. 
Mark Lohman 

Lohman is with NTE . and is an alumnus of the Stanford R & D Center. 
J'o^Zu argument is complex and difficult to summarize, but I will take 

\tTisl rfTs?epresent?ng his position and "^^P^^ J Vand^^p/ol^t'which 
L areues that there is an alternative approach to the Rand P^J^^^/^"^^" 
is much more likely to succeed, if the goal is to find ways of eljf ^^^^^^8 
jLToad blocics to'^desegregation. The survey method he "Sues is bes 

-ijiurtertrfn^sw^^ng r^^^^^^^^^ 

? L r t^^^ trure^;/f^5iraie^r^ 

ycuscJ oi eliJnrtlng particular type, of problems is a more promising 
Strategy. 

« • • • 
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Thus, for example, one """"/"^f ,:f„,:rtthnrc"8rot"pst"Th"rtn..r- 
deslgnod to Close S-P^ b''«e" f ,o . 

:::r:er«rio^%"seHrii:^ri^ La „on« .... .0 appx.. o., 

to schools which volunteered to participate. 
Bernard C. Watson 

Watson U Chair».„ of ^^.^^^^^^^^^^^^^ 

Hatson's comments are brief " but devote, most of his 

,0,^ opposition '')%^:7i^£ricul ie of n^nltoring the study, and 

tre""u"prorosed1^":Ad'on ^"«n-Amer leans and Puerto Ricans. 
He sutnmrrizes himself as follows: 

t would strongly reco™«nd the Civil Right Commission 

rneCoorrtXran^aral^^ls^rf C l^rerature and research 
impinging upon the issues. 

X «ould strongly "co^end that f'^f Jf^^^^.t^rrufrto 
team include blacks -f^/P''"^Sn'llke1ind's reco,;««ndation, 
rruirttrorirure"tK:t-«rrtel;%uestionnaires he prepared 

in Spanish as well as English. 

speaking people. 
Cordon Foster 

.oster is ^-r7.^l:^'XZTrZ^^^^^^^ " 

z "^^^^^^Bd^^ Terir^f-th^ Sn":r 

of specific details of the ^^^^f" are the proposal 

.trategy. His two ""^'/^Smflcant criticisms ^ ; ^^^^ 

to use a large number """""""^'"/".he project to develop a 
previously validated, and the f ^.J^^J 1„ ..,he context of 

r^r^ ll:.ATriiV ^iZ Uonent part." 
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He generally argues for a smaller and tighter study with less room for 
pedantic arguments about the re3ults and more closely tied to specific 
policy objectives. Howev;cr, he notes that research has had little 
impact on policymakers up to now and is pessitnlstlc that further 
research will make much difference. 

He also writes : 

"Initiate a needs assessment from potential research 
consumers. There is little point in spending all this 
money unless there are a substantial number of serious 
consumers who have a problem/' 

^Develop a smaller but tighter survey design w/hich will 
make a complete analysis of the segregatio.i-desegregation- 
integration process and have it all ready to function. Then 
identify ten to twenty systems of different size, location, 
and demographic make-up where it is more likely to happen 
in the next year. Turn on the faucet e.g., Dayton, Ohio; 
Wilmington, Deleware." 

Jean Fairfax 

Jean Fairfax is Director of the Division of Legal Information and 
Community Service for the Legal Defense Fund. She feels that the study 
is a competent design built on a fundamental wrong assuptlon and should 
be reworded from scratch. She wishes the project to view desegregation 
with a "legal, but not a sociological" definition. By that she means 
that the study of bi-racial schools In districts which are not desegregated 
is confusing and misleading. Rather, the study should be restructurad to 
focus explicitly upon legally desegregated districts or districts in the 
process of reaching a state of desegregation which would be acceptable 
to the courts. Ghe argues that the restriction of ths study to those 
ca^es would accomplish two things it would focus the study upon 
dlstrict-level decisioT'?, which is what desegregation means as a legal 
piocess, and in this r rlsed design the emphasis should be upon 
experimental studies test out Innovative projects to enhance 
desegregation. 

Carol H> Smith 

Carol Smith is now Hth the Bureau of Post-Secondary Education in 
0»E«i and is one of the co-authors of Equality of Educational Opportunity . 
She Is generally opposed to the approach of the study. I think it is 
fair to say that she views a value- free survey research study as missing 
the point. Thus she would agree with Lohman^s comments. She writes 
^^tty overall reaction to the focus of the design is negative . I find it 
difficult to reconcile the Commission on Civil Rights spending the bulk 
of 9-14 million for a series of studies to ascertain if the law of the 
land (i.e., desegregation) Is working, rather than expend this amount 
on studies which would show it could be made to work. Pure research 
In this area without some value Judgment will be of very little help 
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in otcering the nation toward law, order and justice. 

She goes on to point to two or three topics which are inadequately 
developed in the design.-- the pcoblem of excessive and unjustified 
suspension and explusion of minority group students, violence 
against minorities by the majority groups, and the firing of minority 
Staff. She writes "Such obvious omissions put the onus of desegregation's 
failure heavily on the shoulders of the minority group." 



Mabel M. Smythe 

Dr. Sjitythe is Vice President for Research and Publication of the Phelps 
Stokes Fund. Smythe. views the survey method as inappropriate to the 
task and reflecting a point of view of establishmentarian white liberals. 
She recommends that the study be cut down, more sharply focused and use 
case study methods to focus on ..he Important issues. She recommends 
dropping the concern with cognitive achievement or sharply reducing it: 
She writes: 

"Focus with imagination and commitment on the noncognitive 
benefits of successfully desegregated schools, defining those 
benefits with care and precision." 

"Do careful case studies of several schools, identifying the 
issues, procedure, community pressures, etc., as well as 
outcomes in terms of the objectives of the study (Boston, 
Denver, Brunswick, Ga., and Miami might be candidates)." 

Joe R. Feagin 

In Feagin' s view the proposal suffers in two areas. It does not 
clearly define desegregation, and it does not focus on classroom 
interaction. He would recommend changing the proposal to distinguish 
more clearly the different ways in which bi-racial schools might come 
about, focusing more attention on district- level complete desegregation. 
In general he also favors an increase in the number of classroom settings 
to be studied in detail, adding classrooms which are not innovative. 
He raises several other problems. Not enough attention has been paid 
to response rate, and the hypotheses in. the proposal are not explicit 
enough. He believes the experimental design to be politically unfeasible. 



He writes: 




Give more thought and attention to the political consequences 
of social science research of this type. E.g., publicity is 
more likely to be given to negative results showing no gains 
for black children (if that should turn out to be a finding) 
in certain types of desegregated schools. What are the implica- 
tions for this for the CRC? The proposal in general suffers 
from a lack of concern with the Institutional context within the 
reaearch will be conducted (indeed, students receive more 
attention than power-holding white adults; is this another 
"victimology" study)? . 
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James Lyons 

Jim Lyons believes that the Rand proposal's critical shor tcomlnRr, 
should preclude its implementation, and goes further to argue that 
a survey-research approach is a mistaken one. He sees two major 
omissions in the design: there is insufficient atti;ntion paid to 
the role of racial composition of educational personnel and the related 
problems of the demotion and dismissal of minority teachers and 
administrators. He concludes by recommending that we "abandon the 
present study design: desist from all efforts to do survey research 
in the area of school desegregation; proceed cautiously with well- 
designed, comprehensive case studies and possibly a few highly 
Structured and controlled experimental studies," 

Gene Mornell 

Mornell cites a number of specific weaknesses in the report that 
it Is not sufficiently policy directed, that it is unclear on what 
types of desegregation it is studying. However, these specific 
criticisms are eclipsed by his more general conclusion that the design 
makes a fundamental mistake in trying to ba all things to all men. He 
concludes by recommending that th's project be abandoned and that we 
Instead "focus on one or two limited studies (I would suggest community 
study and innovative schools) and more carefully design them." He 
States his argument as follows: "The result of Rand's approach is 
a proposal that touches upon 'everything' in the field of school 
desegregation with little effort to state biases clearly, define 
precise objectives, and develop specific hypotheses or models. 
...However, this attempt to be 'objective' is often contradicted by 
the value-laden statements which appear throughout the paper leaving 
the impression that the design is a political document intended to 
appeal to the many points of view of desegregation and the many interests 
of research scientists and funding agencies. 

"This approach is justified by the stated assumption that there is 
little agreement as to which policy issues are more important -- an 
assumption which is clearly false, especially so far as the Commission 
is concerned. It is also based on the stated assumption that no single 
study could succeed in settling the outstanding policy issues -- an 
assumption which is clearly true if the first assumption determines the 
design. However, even given these assuptions and this design, there 
is no way to predict if the study will lead to policy relevant conclusions, 
and indeed it seems likely that it will not lead to such conclusions. 
A greater possibility is that the study will lead to a host of incon- 
clusive, contradictory and insignificant findings, many of which may be 
used to attack desegregation." 
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GregP! Jackson 



Gregg Jackson's highly detailed comments can be very briefly 
aunmarl^ed as follows. On Che one hand, he finds a number of 
correcteble inadequacies in the design. He would recommend using 
a differ.-jnt type of achievement test, adding Spanish translations 
to instruments, reconceptualizing or rewording a number of 
questionn>iire items, recalculating sample types and sizes and 
enlarging them where needed, and adding additional instructions 
on instrument administration. However, he writes "if the above 
inadequaclo.s are corrected this study, and any other design , will 
still be seriously limited in making firm inferc.ces about most 
of the policy relevant aspects of school desegregation. Briefly, 
his point ir, that while everyone recognized the limitations of cross- 
sectional survey design, the Rand report goes or. to point out that 
longitudinal designs do not overcome many of these weaknesses. The 
only guaranteed methodology is the use of the full-blown experiment; 
vhile Rand proposes such en experiment for a portion of this study, 
it understates the difficulty of carrying an experiment out. First, 
he argues that innovations in school practices which will succeed will 
have to be very broadly based, affecting the entire school, and that 
such wide-range innovations will be politically unacceptable. Secondly, 
even if they were politically acceptable the task of training teachers 
and principals would become enormous and unwieldy, and it would be 
almost impossible to maintain the integrity of the "treatments" over 
the prolonged period of time needed to assess the slowly accumulating 
effects of schooling. He concludes: "Consequently, I do not believe 
any possible design (experimental or non-experimental) is likely to 
yield fairly unambiguous results about the sort of complex innovations 
which most informed observers believe are necessary to make desegregation 
work well. Unless we can justify the utility of fairly ambiguous results, 
or can knowledgeably suggest some discrete innovations which can be 
expected to significantly affect the outcome of schooling, we probably 
should save the taxpayer's money." 

Gary Or field 

Orfield's numerical rating :>f the proposal is most favorable of the ^ 
Commission staff members (i.8, compared to Joe Feagin's 2.2, Jackson s 
2.6, and 3 ratings below 3.3). His comments are generally very brief. 
He believes that more work should be done in conceptualizing the 
relevance of the research for Spanish speaking groups and believes the 
sampling scheme is too complex. He concludes by recommending (1) a 
more competent section on Chicano and Puerto Rican educational problems 
and their interactions with desegregation and the development of more 
appropriate instruments to study these students' outcomes, (2) a stronger 
concentration on elementary grades with particular attention to impacts 
of beginning schools in desegregated and integrated settings both in 
the large study and in the study of newly desegregated schools. 
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